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In a previous paper a series expansion method for calculating the error 
probability o] a binary digital AM system in the presence of intersymbol 
interference and additive gaussian noise ivas derived. 1 In this paper those 
results are extended to the multilevel case. In the examples calculated for a 
four-level system, this method is 10* times faster than the exhaustive method 
and is 10 2 times more accurate than the Chemoff bound. The actual compu- 
tation time with an 11 -sample approximation to the real system impulse 
response is only 1.8 seconds with the GE Mark II time-sharing system. 

I. INTRODUCTION 

In a recent paper 1 we have developed a new method to calculate the 
error probability of a binary digital data system in the presence of 
intersymbol interference and additive gaussian noise. A similar method 
has also been reported by M. I. Celebiler and 0. Shimbo. 2 The purpose 
of this paper is to extend the previous results to multilevel systems. 

The existing methods for the estimation of the error probability are 
the Chernoff bound or the worst case bound, 3 ' 4 the results of which are 
generally too loose. Another alternative is the time-consuming exhaus- 
tive method. 3 For example, it would require 4 10 (£3 10 6 ) calculations of 
the error function to find the error probability of a four-level digital 
system where intersymbol interference resulted from ten nonzero 
samples of the channel impulse response. 

II. DERIVATION OF THE EXPRESSION FOR ERROR PROBABILITY 

For a 2m-level digital AM system, the corrupted received sequence at 
the input to the receiver detector is 
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where 



and 



y(t) = £ M<- IT) +*»(*), 

l=-co 

n(0 is additive gaussian noise, 
a, = dslj ±3, • • • , ±(2m — 1) with equal probability, 

r(t) is the given noiseless system impulse response. 



(1) 



At the detector, y(t) is sampled every T seconds to determine the 
amplitude of the transmitted signal. At sampling time t , the sampled 
signal is, 



y(Q = a r(Q + E OiKtn - IT) + n(t ). 



(2) 



1*0 



The first term is the desired signal while the second and the third terms 
represent the intersymbol interference and gaussian noise respectively. 
The set of slicing levels are, 5 

0, ±2r(< ), ±4r(«o), • • • , ±(2m - 2)r(t ). (3) 

Given a particular transmitted signal level, a n , the conditional error 
probability is, 

P T (e/a ) 

P{y(t ) ^ -2(w - l)r(t )}, a = -(2m - 1), 

P{y(t ) £ 2(m - l)r(*„)}, a = 2m - 1, 

P{(v(«o) ^ (a + l)r(t ))U(y(t ) ^ (a - l)rfo,))}, 

a ^ ±(2m - 1), 

where AUB is the union of the events A and B. 
Substituting equation (2) into (4), we obtain 

P r (e/a ) 

[P{ £ a,r(* - Zr) + n(t ) ^ r(t )}, a = -(2m - 1), 



(4) 



P{ £ «iK<o - IT) + n(«o) ^ -r(t )}, a = 2m - 1, 
P{(E air(«o - IT) + n(«o) ^ r(Q)U, 

1*0 

(Z «iK*o - IT) +n(«o) ^ -K*o))}, «o 5* ±(2m - 1). 



(5) 
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Since E'*o &ir(U — IT) and n(t ) are equally likely to be positive or 
negative, equation (5) reduces to 

P r (e/a ) 

' P[ E aiKU - IT) + n(to) > r(t )}, a = ±(2m - 1), 

2P{ E airik ~ IT) + n(t ) ^ r(t )}, a * ±(2ro - 1). 

L i*o 

The error probability of the system is, 
P. = E Pr(e/<h)Pr(flo), 



(6) 



iii 

2m - 1 
m 



Pi E «iK«o - HO + n(0 ^ r((o)} . (7) 



We note that equation (7) is similar to equation (7) of Ref. 1, with 
the only exception that the a t can now assume multiple values. Accord- 
ing to equation (9) of Ref. 1, we obtain the following expansion for P e , 

Pt = lirLZLl erfc (_r(to) 



+ 



2m ' \ \/2 
2m - 



m 



if i my i m r r2 <«l 
- k w\ \2?) v; exp \r~&~l 



■«»-W M » • (8) 

where 

a 2 is the noise power, 

H 2 k-i is the Hermite polynomial, 

erfc is the complementary error function, 

M 2 k is the 2/cth moment of the random variable X, 

and 

X = E o,r(«o - IT), <*« = ±1, ±3, • • • , ±(2m - 1). (9) 

1*0 

The moments can again be obtained through the characteristic function 
of X without the explicit evaluation of the distribution function. The 
characteristic function is, 

*(«) = II { E exp [p>{2k - l)r(«o - lT)]/2m\ , 

1*0 U = -m+l ) 

= II W~ sin [2wtor(<o - IT)]- cac [wrfo - ZT)]f- (10)* 



♦See Ref. 6, equation (1.342). 
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Therefore, 



<!>'(«) = *(«){2m £K*o - IT) cot [2mta(to - IT)] 

1*0 

- £K«d - ff) cot [wrft, - ff)]}. 



(11) 



Since ilf 2fc = ( — 1) A '* 2 '"(0) and M 2 a_i = 0, we obtain a recurrence 
formula for M 2k by successive differentiation of equation (11), 



_. 4. (2k - l\._ , 1V - 2 2, [(2m) 2 ' 

■[2>(*«- HO 1 *], 



-1] 



£ 2 



(12) 



where B 2i is the Bernoulli number obtained by series expansion of 
cotangent function about the origin. Knowing that M = 1, all the 
Mat's can be calculated successively through equation (12) for an 
AT-sample approximation of the channel pulse response. The iV-sample 
truncation is equivalent to the approximation of ^2i* Q r(t — lT) 2k by 
(N — I) summation terms. 

The error probability of a 2m- level system can thus be obtained by 
equations (8) and (12). In the special case m = 1, equations (8) and 
(12) agree with the results of the binary system, i.e., equations (9) 
and (15) of Ref. 1. 



III. TRUNCATION ERROR BOUND 



The error incurred by truncating the series expansion of equation (8) 
at a finite term n — 1 is, 



^t2n = 



2m - 



m 



S(2fc)!L2a 2 J V^ CXP 



r\U) 
" 2a 2 . 



•H 2k .J^-)M 



Let 



(13) 



X = maximum { | ^ a,ir(i — IT) \ } , 

1*0 

= (2m - 1) E \r(t -IT) \. (14) 

It can be shown that the moments satisfy the following inequality, 

M 2k+2p ^ M 2k \ 2v , p = 0, 1, 2, • • • (15) 
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For (2k — 1) » x, the Hermite polynomials are upper bounded by, 

| #„_,(*) | ^ 2*-»[(2Jfc - 3)!!]V2fc - lexp [x*/2]. (16) 

Substituting equations (16) and (15) into equation (13) and grouping 
the terms into geometric series, we obtain an upper bound for R 2n ■ 



R', 



S (,, = ^^^-)=(exp[-r 2 (*o)/4<r 2 ]) 



m 



y/2-K 



M, 



(20 n n!\/2n - 1 







1 




1 - 


[(2m - 


-DEI r«. - 

1*0 


- IT) |] 2 




2n<r 2 





(17) 



IV. EXAMPLE 



We have calculated the error probability of a four-level digital AM 
system with the received pulse given by 

r(t) = — 4 sm (irt/T). 
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Fig. 1 — Comparison of Chernoff Bound and series expansion method. Sin 
Wt/T]/W/T)L pulse, 11-pulse truncation approximation, t« = 0.05T, (S/N) = 
24 dB. 
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CHERNOFF BOUND 
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EXHAUSTIVE METHOD 
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Fig. 2 — Comparison of series expansion method with Chernoff Bound and 
exhaustive method. [SIN irt/T]/(w/T)t pulse, 5-pulse truncation approxima- 
tion, t = 0.05T, (S/N) = 24 dB. 



With an 11-sample approximation, a S/R of 24 dB and a sampling 
time of t = 0.05 T, the error probability obtained by the Chernoff 7 * 
bound is 2 X 10~*. The result obtained by our method is 3.4 X 10~ 8 
indicating an improvement of two orders of magnitude. The conver- 
gence of equation (8) is presented in Fig. 1. Reasonable accuracy is 
achieved after eight terms of the series are calculated. A check of the 
accuracy of our method by comparison with the exhaustive method is 
impossible in this case because the latter requires 10 4 times more com- 
putation time as compared to the series expansion method. Instead, we 
checked our method with the exhaustive method for the case of a five- 
sample approximation. The results agree well and are presented in 



* 11-sample approximation to the channel response is used in calculating the 
Chernoff bound. 
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Fig. 2. The computation time spent on GE Mark II time-sharing sys- 
tem is approximately 1.3 seconds for the series expansion method in 
both the eleven-sample and the five-sample approximations. The 
truncation error bounds are also presented in both figures. 

V. CONCLUSIONS 

We have extended the series expansion evaluation of the error prob- 
ability of a binary digital AM system in the presence of intersymbol 
interference and additive gaussian noise to the 2m-level systems. The 
results are extremely encouraging. For the case examined the series ex- 
pansion method was calculated several orders of magnitude faster 
than the exhaustive method, and it was more accurate than the Cher- 
noff bound by two orders of magnitude. 
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